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I.  INTRODUCTION 

Since  the  establishment  of  the  international  candle  in  1909 
this  unit  has  been  maintained  at  the  Bureau  of  Standards  solely 
by  means  of  a  group  of  4-wpc  carbon  filament  incandescent 
lamps.  With  the  advent  of  the  tungsten  lamp  there  v/as  intro- 
duced into  standardization  work  the  difficulty  of  comparing  lights 
of  different  colors,  and  at  once  it  became  desirable  to  have  the 
unit  well  established  also  in  tungsten  lamps  operated  at  or  near 
their  normal  color. 

In  191 1,  by  common  agreement  between  the  National  Physical 
Laboratory  of  England  and  the  Bureau  of  Standards,  each  labo- 
ratory prepared  a  group  of  tungsten  standards  calibrated  for 
voltage  corresponding  to  approximately  1.5  wpc.  These  two 
groups  of  lamps,  which  were  thus  operated  at  very  approxi- 
mately the  same  color,  were  then  exchanged  and  each  group  was 
remeasured  by  the  receiving  laboratory  at  the  voltage  determined 
by  the  sending  laboratory.  A  group,  similar  to  the  one  sent  to 
England,  and  standardized  in  the  same  series  of  measurements, 
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was  retained  at  the  Bureau,  and  half  of  the  group  received  from 
England,  after  measurement,  was  returned  for  remeasurement. 

In  view  of  the  difficulties  involved  in  the  intercomparison,  the 
result  was  very  satisfactory,  as  it  showed  that  the  two  laboratories 
were  in  agreement  to  within  the  indicated  precision  of  the  meas- 
urements. In  both  laboratories  the  new  standards  were  meas- 
lu-ed  by  means  of  Lummer-Brodhun  contrast  photometers  of  the 
standard  type,  and  in  terms  of  similar  groups  of  4-wpc  carbon 
standards,  the  English  laboratory  having  made  the  comparison  by 
the  cascade  method,^  the  Bureau  of  Standards  by  the  use  of  two 
calibrated  blue  glass  screens,  each  of  which  produced  a  color 
match  between  the  two  groups  of  standards  compared.  It  is  ob- 
vious, therefore,  that  the  calibration  of  the  glass  screens  used  by 
the  Bureau  in  this  intercomparison  was  a  matter  of  prime  impor- 
tance, and  for  this  reason  a  large  amount  of  work  has  been  done 
in  checking,  by  various  methods,  the  values  first  assigned. 

In  connection  with  these  check  measurements  and  after  a 
determination  of  the  candlepower  and  current  of  a  group  of  tung- 
sten substandards  at  several  voltages  had  been  made,  and  this 
followed  by  a  further  investigation  of  other  groups  of  tungsten 
lamps,  the  voltage-current-candlepower  curves  were  determined 
and  accurately  expressed  by  means  of  equations.^  It  was  found 
that  by  employing  these  equations  it  is  possible  to  measure 
tungsten  lamps  in  color  match  with  4-wpc  carbon  standards  and 
compute  with  accuracy  their  value  at  any  other  color  within  the 
range  investigated.  In  this  way,  as  well  as  by  direct  compari- 
sons, the  new  tungsten  standards  have  been  rechecked  a  number 
of  times  by  different  groups  of  observers. 

These  equations  have  an  important  application  also  in  the  life 
testing  of  tungsten  lamps,  because  in  some  testing  laboratories 
it  is  customary  to  photometer  the  lamps  at  or  near  rated  voltage 
and  compute  the  voltage  corresponding  to  the  efficiency  at  which 
it  is  desireft  to  burn  the  lamps  on  life  test. 

In  the  establishment  of  the  1.5-wpc  tungsten  standards  and 
also  in  the  determination  of  the  characteristic  equations,  the 
photometric  measurements  of  necessity  involved  color  differences. 
Although  numerous  check  measurements  have  been  made  and 
the  results  have  been  very  satisfactory,  it  is,  of  course,  realized 

^  Paterson  and  Dudding,  Proc.  Phys.  Soc.  I^ondon,.  p.  263,  Apr.  15,  1915;  also   Phil.  Mag.,  p.  63,  July, 

191S. 

2  Middlekauff  and  Skogland,  Characteristic  Equations  of  Tungsten  Filament  I^amps  and  their  Appli- 
cation in  Heterochromatic  Photometry,  Trans.  I.  E.  S.  9,  p.  734.  1914;  also  this  Bulletin,  11,  p.  483,  zgis- 
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that  if  some  other  group  of  observers  had  made  these  measure- 
ments the  values  obtained  might  have  been  different. 

It  was  therefore  suggested  that  an  interlaboratory  photometric 
comparison  of  hghts  involving  color  differences  such  as  those 
encountered  in  these  measurements  would  yield  valuable  infor- 
mation not  only  as  to  the  agreement  which  might  be  reasonably 
expected  among  different  groups  of  experienced  observers,  but 
also  information  as  to  the  merits  of  different  methods  of  making 
such  measurements. 

II.  LABORATORIES  COOPERATING 

The  Bureau,  therefore,  in  May,  1914,  invited  several  of  the 
more  important  photometric  laboratories  of  the  country  to 
cooperate  with  it  in  making  measurements  of  this  kind. 

Through  Dr.  E.  P.  Hyde,  Dr.  C.  H.  Sharp,  and  Dr.  H.  E. 
Ives,  respectively,  the  Nela  Research  Laboratory,  the  Electrical 
Testing  Laboratories,  and  the  Physical  Laboratory  of  the  United 
Gas  Improvement  Co.  kindly  agreed  to  make  such  measurements 
on  glass  screens  and  tungsten  lamps  as  the  Bureau  would  direct. 

III.  SCREENS,  LAMPS,  AND  INSTRUCTIONS  AS  TO  METHODS  OF  MEAS- 
UREMENT 

For  this  intercomparison  there  were  selected  three  blue  glass 
screens  of  different  color  densities  and  marked  2B,  2XB,  and  3B, 
respectively.  2^  B  was  of  approximately  the  same  color  density 
as  the  screens  used  by  the  Bureau  in  the  intercomparison  with 
England,  and  was  therefore  such  as  to  produce  a  color  match 
between  the  4-wpc  carbon  standards  and  the  1.5-wpc  tungsten 
standards.  2B  and  3B  were  of  lesser  and  greater  color  density, 
respectively,  than  2XB,  producing  a  color  match  between  the  4- 
wpc  carbon  standards  and  timgsten  lamps  at  about  1.9  wpc  and 
1.25  wpc,  respectively. 

The  transmission  of  each  glass  for  light  of  4-wpc  carbon  color 
was  to  be  determined  by  each  laboratory,  and,  in  order  that 
the  proper  color  might  be  used,  a  carbon  standard  of  this  color 
at  a  specified  voltage  was  sent  along  with  the  screens. 

There  were  selected  also  four  timgsten  standards  to  be  meas- 
ured for  candlepower  and  current  at  several  specified  voltages, 
the  color  at  the  lowest  voltage  being  the  same  as  that  of  the  4- 
wpc  carbon  standards.  The  candlepower  at  the  other  voltages 
was  to  be  determined  in  terms  of  the  value  at  the  lowest  voltage 
taken  as  standard,  or  unity. 
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The  voltages  specified  for  these  measurements  corresponded 
to  a  range  from  3.1  wpc  to  0.85  wpc  for  the  tungsten  lamp. 
The  lamps  were  selected  from  those  used  in  the  investigation  of 
the  characteristic  curves  and  included  a  60-watt  sintered  filament 
lamp  (No.  2608);  a  60-watt  ''formed"  drawn-wire  lamp  (No. 
2662)  with  spring  anchors;  and  two  40- watt  drawn-wire  lamps 
(Nos.  2865  and  2866). 

As  the  purpose  of  the  investigation  was  to  obtain  information 
as  to  methods  and  the  agreement  of  different  groups  of  observers 
in  passing  from  one  color  to  another  in  photometric  measurements, 
no  instructions  other  than  those  mentioned  above  were  issued  to 
the  laboratories.  It  was  desired  that  each  laboratory  proceed  by 
the  method  it  considered  best,  and  it  was  not  expected  that  a  large 
number  of  measurements  would  be  made.  Hence,  in  view  of  the 
difficulties  which  were  to  be  met  in  these  measurements,  it  was 
hardly  to  be  expected  that  values  established  by  the  Bureau  as  the 
result  of  a  much  larger  number  of  measurements  and  checks 
would  be  repeated  exactly.  However,  as  will  appear  later,  the 
results  of  all  the  laboratories  are  extremely  consistent  and  the 
agreement  quite  satisfactory. 

Tw^o  of  the  laboratories  (E.  T.  L.  and  N.  R.  I^.)  used  standard 
type  Lummer-Brodhun  contrast  photometers  in  all  the  measure- 
ments. The  third  laboratory  (U.  G.  I.),  in  the  measurements  on 
the  screens,  used  a  special  flicker  photometer,^  and  in  the  measure- 
ments on  the  lamps  a  Lummer-Brodhun  photometer  having  in 
the  eyepiece  a  cell  containing  a  Crova  solution  ^  which  was  cali- 
brated b}^  a  method  involving  the  flicker  photometer.  All  the 
measurements  by  the  U.  G.  I.  were  made  under  selected  conditions 
of  illumination  and  with  groups  of  observers  selected  after  tests 
of  their  color  vision  with  respect  to  the  average  of  much  larger 
groups.  The  data  obtained  are  therefore  valuable  in  making  a 
comparison,  not  only  of  observers  but  also  of  different  methods  of 
meastu-ement. 

In  no  laboratory  were  the  lamps  measured  at  the  same  time  as 
the  screens,  a  period  of  from  4  to  13  months  having  intervened 
between  the  two  series.^  Although  this  was  not  intentional,  it 
fortunately  proved  of  value  in  showing  that  each  laboratory  con- 
sistently maintained  its  criterion  in  measurements  involving  a 

8  H.  E.  Ives,  Phys.  Rev.,  p.  222;  Sept.,  1914. 

*  Ives  and  Kingsbury;  Trans.  I.,  E.  S.,  10,  p.  716;  1915. 

6  The  intercomparison  was  begtm  in  June,  1914,  but  was  not  completed  until  in  December,  1915. 
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color  difference.  In  order  to  avoid  confusion,  all  the  results, 
including  those  cf  the  Bureau,  on  the  screens  are  given  together, 
as  are  likewise  "..:  ^ne  results  on  the  lamps. 

IV.  RESULTS  ON  THE  SCREENS 

The  values  for  the  screens  are  given  in  the  four  following  tables, 
and,  except  as  noted,  they  are  as  stated  in  the  reports  from  the 
laboratories.  The  results  of  the  three  laboratories  using  Lummer- 
Brodhun  photometers  are  grouped  together,  and  when  comparisons 
are  made,  flicker  values  are  compared  with  the  mean  of  those 
obtained  with  the  Lummer-Brodhun. 

TABLE  1 
Values  of  Transmission — Bureau  of  Standards 


2B 

2J^B 

- 

Observers 

Indirect 
method 

Direct 
method 

Indirect 
method 

Direct 
method 

Indirect 
method 

Direct 
method 

G.  W.  M            

0.652 
.651 
.648 
.652 
.652 
.651 
.651 
.650 

0.654 
.652 
.645 
.667 
.652 
.648 
.655 
.652 

0.585 
.585 
.581 

(a) 
.585 
.581 
.584 
.585 

0.588 
.584 
.575 
.596 
.580 
.581 
.583 
.582 

0.537 
.538 
.541 

(a) 
.539 
.535 
.541 
.538 

0  542 

J.F.S 

B.  M 

.538 
.526 

H.  B.  S      

.552 

W.J.K 

W.H.V 

A.H.T 

G.J.S 

.534 
.535 
.535 
.536 

IVEe&n 

.651 

.653 

.584 

.584 

.538 

537 

a  Observer  not  available. 

The  photometer  used  was  the  standard  Lummer-Brodhun  con- 
trast. The  approximate  illumination  on  the  photometer  screen 
was  10  meter-candles.. 

Methods. — i .  Direct  Method. — The  screen  was  placed  on  the  test 
side  of  the  photometer,  the  test  lamp  (a  tungsten)  was  set  to  4-wpc 
carbon  color,  and  the  comparison  lamp  (also  a  tungsten)  was 
adjusted  to  match  in  color  the  light  transmitted  by  the  screen. 
Photometric  settings  were  made  first  with  the  screen  in  place, 
then  with  it  removed,  there  being  a  color  difference  under  the 
latter  condition.  The  ratio  of  the  first  settings  to  the  second  gave 
the  transmission  of  the  screen. 

2.  Indirect  Method. — The  first  settings  were  made  as  in  the 
direct  method,  but  when  the  screen  was  removed  the  test  lamp 
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was  sufficiently  increased  in  voltage  to  produce  a  color  match 
with  the  comparison  lamp.  The  ratio  of  the  candlepower  of  the 
test  lamp  at  these  two  voltages  was  computed  by  means  of  the 
voltage-candlepower  equation.  With  this  factor  appHed,  the  ratio 
of  the  settings,  screen  in  to  screen  out,  gave  the  transmission. 

In  both  of  the  above  methods,  when  the  screen  was  removed 
it  was  replaced  by  a  rotating  sectored  disk  of  the  proper  opening 
to  make  the  photometer  balance  at  about  the  same  point  as  when 
the  screen  was  in  place. 

Each  value  in  Table  i  is  the  mean  of  about  four  independent 
determinations,  the  average  deviation,  by  either  method,  being 
about  0.5  per  cent. 

TABLE  2 

Values  of  Transmission — ^Electrical  Testing  Laboratories 


2B 

zy2B 

SB 

Observers 

Series 
1 

Series 
2 

Weiglited 
mean 

Series 
1 

Series 
2 

Weighted 
mean 

Series 

1 

Series 
2 

Weighted 
mean 

C.H.S 

W.F.L 

M.H.T 

C.E.H 

W.A.M 

Z.N.C 

A.  K     



0.651 
.650 
.660 
.656 
.656 
.653 
.659 

0.672 
.662 
.652 
.657 

.666 

0.651 
.666 
.661 
.655 
.655 
.653 
.659 
.666 

0.583 
.594 
.585 
.586 
.587 
.579 
.589 

0.586 
.588 
.587 
.576 

.594 

0.583 
.590 
.585 
.586 
.583 
.579 
.589 
.594 

0.537 
.530 
.545 
.545 
.543 
.535 
.539 

0.553 
.546 
.537 
.539 

.555 

0.537 
.542 
.545 
.542 
.542 
.535 
.539 

E.H 

.555 

Mean 

.656 
.656 

.662 
.659 

.586 
.585 

.586 
.586 

.539 
.541 

.546 
.543 

Weighted  mean 

.657 

.585 

.542 

The  photometer  used  was  the  standard  Lummer-Brodhun  con- 
trast. The  approximate  illumination  on  the  photometer  screen 
was  2.5  to  3.8  meter-candles.  As  the  distance  between  test  and 
comparison  lamps  was  fixed,  the  illumination  depended  upon  the 
screen  used  and  was  highest  with  the  screen  removed. 

Method:  Direct. — Two  carbon  lamps,  each  operated  at  a  voltage 
giving  a  match  in  color  with  the  B.  S.  4-wpc  carbon  lamp,  were 
set  up  at  opposite  ends  of  a  five-meter  photometer.  Settings  were 
made,  first  without  the  screen,  then  with  the  screen  interposed. 
This  was  done  first  on  one  side  of  the  photometer  and  then  on  the 
other.  The  observers  were  weighted  according  to  their  experi- 
ence in  color  difference  measurements  and  the  number  of  meas- 
urements made  in  these  tests.     Series  i  and  2  are  independent 
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determinations  by  this  method.  For  purposes  of  comparison  the 
weighted  mean  values  (columns  4,  7,  and  10)  for  each  observer 
were  computed  by  the  authors. 

TABLE  3 

Values  of  Transmission — Nela  Research  Laboratory 


Observers 

2B 

2KB 

3B 

Series  1 

Series  2 

Mean 

Series  1 

Series  2 

Mean 

Series  1 

Series  2 

Mean 

E.P.H 

F.E.C 

M.  L 

0.660 
.659 
.665 
.652 
.664 
.656 

0.662 
.661 
.660 
.650 
.662 
.656 

0.661 
.660 
.662 
.651 
.663 
.656 

0.590 
.592 
.593 
.578 
.594 
.584 

0.592 
.590 
.590 
.578 
.592 
.584 

0.591 
.591 
.592 
.578 
.593 
.584 

0.544 
.548 
.551 
.531 
.550 
.540 

0.543 
.546 
.541 
.530 
.549 
.538 

0.544 
.547 
,546 

C.F.S 

R.G.B 

I.R.W 

.531 
.550 
.539 

Mean 

.659 

.6585 

.659 

.5885 

.588 

.588 

.544 

.543 

.543 

The  photometer  used  was  the  standard  Lummer-Brodhun  con- 
trast. The  approximate  illumination  on  photometer  screen  was  1 7 
meter-candles. 

Method. — Same  as  the  B.  S.  direct  method;  except  that  the 
screen  and  sectored  disk  were  employed  on  the  side  of  the  com- 
parison lamp,  which  was  set  to  4-wpc  carbon  color.  Series  i 
and  2  are  independent  determinations  by  this  method. 

TAPLE  4 
Values  of  Transmission — United  Gas  Improvement  Co. 


2B 

2i^B 

SB 

Observers 

Series 
1 

Series 
2 

Mean 

Series 

1 

Series 

2 

Mean 

Series 
1 

Series 
2 

Mean 

H.E.I 

E.F.K 

F.A.S 

B.J                      ... 

0.645 
.658 
.645 
.656 
.639 
.637 
.640 

0.650 
.661 
.645 
.642 
.642 
.639 
.643 

0.  6475 
.6595 
.6455 
.6490 
.6405 
.6380 
.6415 

0.580 
.587 
.583 

.575 
.585 
.572 
.575 

0.579 
.588 
.577 
.574 
.578 
.573 
.577 

0. 5795 
.5875 
.5800 
.5745 
.5815 
.5725 
.5765 

0.534 
.548 
.528 
.528 
.529 
.521 
.521 

0.527 
.543 
.523 
.528 
.522 
.522 
.528 

0.  5305 

.5455 

.5255 

5280 

D.  V.L.D 

E.J.B 

W.  M.  W 

.5255 
.5215 
.5245 

Mean 

.646 

.646 

.646 

.580 

.578 

.579 

.530 

.528 

.529 

The  photometer  used  was  a  special  flicker  (see  footnote  3) .  The 
brightness  of  the  photometer  field  was  that  of  a  magnesium  oxide 
surface  under  25  meter-candles  illumination. 
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Method:  Direct. — The  measurements  were  made  by  seven 
observers  so  selected  from  25  that  their  mean  on  the  color  difference 
for  which  they  were  tested  was  the  same  as  that  of  the  25. 

TABLE  5 
Deviations  of  Each  Observer  From  the  Mean  of  His  Laboratory 


BUREAU  OF  STANDARDS 
Direct  Method 

Transmission 

Deviation  of  observers 
from  mean  of  all 

Mean 

of 
devia- 
tions 

Maxi- 
mum 
differ- 

Observers 

2B 

2MB 

3B 

Mean 

2B 

23^ 

3B 

ence 
be- 
tween 
devia- 
tions 

G.W.M 

J.F.S 

B.M 

H.B,  S         

0.654 
.652 
.645 
.667 
.652 
.648 
.655 
.652 

0.588 
.584 
.575 
.596 
.580 
.581 
.583 
.582 

0.542 
.538 
.526 
.552 
.534 
.535 
.535 
.536 

0.595 
.592 
.582 
.605 
.589 
.588 
.591 
.590 

+0. 001 

-  .001 

-  .008 
+  .014 

-  .001 

-  .005 
+  .002 

-  .001 

+0. 004 
.000 

-  .009 
+  .012 

-  .004 

-  .003 

-  .001 

-  .002 

+0.  005 
+  .001 

-  .011 
+  .015 

-  .003 

-  .002 

-  .002 

-  .001 

0.003 
.001 
.009 
.014 
.003 
.003 
.002 
.001 

0.004 

.002 

.003 

003 

W.J.K 

W.H.V 

A.H.T 

G.J.S 

.003 
.003 
.004 
.001 

Mean 

.653 

.584 

.537 

.591 

.004 

.004 

.005 

.004 

.003 

Indirect  Method 

G.W.M 

T.  F.  S 

0.652 

.651 
.648 
.652 
.652 
.651 
.651 
.650 

0.585 
.585 
.581 

0.537 
.538 
.541 

0.591 
.591 
.590 

+0.  001 
.000 

-  .003 
+  .001 
+  .001 

.000 
.000 

-  .001 

+0.  001 
+  .001 
-  .003 

-0.  001 

.000 

+  .003 

0.001 
.000 
.003 

0.002 
001 

B.M     

005 

H.B.S 

W.J.K 

W.H.V 

A.H.T 

.585 
.581 
.584 
.585 

.539 
.535 
.541 
.538 

.592 
.589 
.592 
.591 

+  .001 

-  .003 

.000 

+  .001 

+  .001 

-  .003 

+  .003 

.000 

.001 
.002 
.001 
.001 

.000 
.003 
.003 

G.J.S 

.002 

Mean .        

.651 

.584 

.538 

.591 

.001 

.001 

.002 

.001 

.002 

ELECTRICAL  TESTING  LABORATORIES  (Direct  Method) 

C.H.S 

W.F.L 

M.H.T 

C.  E.  H 

0.651 
.666 
.661 
.655 
.656 
.653 
.659 
.666 

Q.583 
.590 
.586 
.586 
.583 
.579 
.589 
.594 

0.537 
.542 
.545 
.542 
.542 
.535 
.539 
.555 

0.590 
.599 
.597 
.594 
.594 
.589 
.596 
.605 

-0.  006 
+  .009 
+  .004 

-  .002 

-  .001 

-  .004 
+  .002 
+  .009 

-0.002 
+  .005 
+  .001 
+  .001 

—  .002 

-  .006 
+  .004 
+  .009 

-0. 005 
.000 

+  .003 
.000 
.000 

-  .007 

-  .003 
+  .013 

0.  004 
.005 
.003 
.001 
.001 
.005 
.003 
.010 

0.004 
.009 
.003 
.003 

W.A.  M 

.002 

Z.  N.  C 

.003 

A.K                        

.007 

E.  H 

.004 

Mean 

.657 

.585 

.542 

.595 

.005 

.004 

.004 

.004 

.004 

Middlekauffl 
Skogland       J 


Photometric  Comparisons 

TABLE  5— Continued 
Deviations  of  Each  Observer  From  the  Mean  of  His  Laboratory — Continued 

NELA  RESEARCH  LABORATORY  (Direct  Method) 
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Transmission 

Deviation  of  observers 
from  mean  of  all 

Mean 

of 
devia- 
tions 

Maxi- 
mum 
differ- 

Observers 

2B 

2HB 

SB 

Mean 

2B 

2HB 

3B 

ence 
be- 
tween 
devia- 
tions 

E.P.H 

F.E.C 

M.  L 

0.661 
.660 
.662 
.651 
.663 
.656 

0.591 
.591 
.592 
.578 
.593 
.584 

0.544 
.547 
.546 
.531 
.550 
.539 

0.599 
.599 
.600 
.587 
.602 
.593 

+0.002 
+  .001 
+  .003 

-  .008 
+  .004 

-  .003 

+0. 003 
+  .003 
+  .004 

-  .010 
+  .005 

-  .004 

+0.001 
+  .004 
+  .003 

-  .012 
+  .007 

-  .004 

0.002 
.003 
.003 
.010 
.005 
.004 

0.002 
.003 
001 

C.F.S 

R.G.B 

I.R.W 

.004 
.003 
.001 

.659 

.588 

.543 

.597 

.003 

.005 

.005 

.004 

.002 

UNITED  GAS  IMPROVEMENT  CO.  (Direct  Method) 


H.E.I 

E.F.K 

F.  A.  S 

0.648 
.660 
.646 
.649 
.640 
.638 
.642 

0.580 
.588 
.580 
.574 
.582 
.572 
.576 

0.530 

.546 
.526 
.528 
.526 
.521 
.524 

0.586 
.598 
.584 
.584 
.583 
.577 
.581 

+0.002 

+  .014 

.000 

+  .003 

-  .006 

-  .008 

-  .004 

+0.001 
+  .009 
+  .001 

-  .005 
+  .003 

-  .007 

-  .003 

1      1      1      1      1    +   + 
P 

8  1  8  8  8  g  8 

0.001 

.013 
.001 
.003 
.004 
.008 
.004 

0.001 
.008 
.004 

B.  T  

.008 

D.  V.L.D 

E.J.B 

W.  M.  W 

.009 
.001 
.002 

Mean 

.646 

.579 

.529 

.585 

.005 

.004 

.005 

.005 

.005 

(a)  Comparison  of  Individuals'  Values. — ^Another  statement 
of  the  results,  including  only  the  mean  of  the  values  obtained  by- 
each  observer  on  each  of  the  three  screens,  is  given  in  Table  5.  In 
the  fifth  column  is  given  the  mean  of  the  values  of  each  observer 
for  the  three  glasses.  In  the  sixth,  seventh,  and  eighth  columns 
are  the  deviations  of  each  observer's  value  from  the  mean  of  his 
laboratory  on  each  glass.  The  constancy  of  the  ratio  of  an  ob- 
server's determination  to  that  of  his  laboratory  shows  the  con- 
sistency with  which  he  maintains  his  criterion  throughout  the 
range  of  color  included.  An  examination  of  the  deviations  shown 
in  this  table  (excluding  for  the  present  those  of  the  Bureau  by 
the  indirect  method)  shows  that  practically  every  observer,  irre- 
spective of  the  kind  of  photometer  used,  maintained  a  fairly  defi- 
nite relation  to  the  mean  of  the  observers  of  his  latDoratory.  An 
observer's  agreement  with  himself  is  indicated  by  the  differences 
given  in  the  last  column  of  the  table. 
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By  the  indirect  method  the  variations  among  observers  is 
avoided,  the  difficulties  of  measurements  with  a  color  difference 
having  been  previously  met  in  the  determination  of  the  char- 
acteristic equation  upon  which,  of  course,  the  values  obtained 
depend.  As  shown  by  the  table,  the  deviations  of  all  observ- 
ers are  about  equal  and  about  one-fourth  what  they  are  by 
the  direct  (color  difference)  method,  although  there  is  practically 
the  same  degree  of  agreement  of  an  observer  with  himself.  The 
chief  advantage  of  this  method  in  calibrating  a  screen  is  that  a 
reliable  result  may  be  obtained  by  any  group  of  observers,  while 
by  the  direct  method  the  results  may  be  somewhat  different, 
depending  upon  the  characteristics  of  the  observers. 

{h)  Comparison  of  Laboratories'  Vai^ues. — In  order  to 
show  in  the  same  way  the  agreement  among  the  various  labora- 
tories, each  taken  as  a  unit,  the  final  means  for  each  laboratory 
are  given  in  Table  6,  in  which,  as  before,  the  flicker  values  are 
compared  with  the  mean  of  those  obtained  with  the  Tummer- 
Brodhun  photometer. 

TABLE  6 

Deviations  of  Laboratories*  Values  from  the  Mean  of  the  Three  Using  Lmmner- 

Brodhun  Photometers 

Ltunmer-Brodhun  Photometer 


Laboratories 

Transmission 

Deviations  from  mean 
L-B  values 

Mean 

of 
devia- 
tions 

Maxi- 
mum 
difference 
between 
devia- 
tions 

2B 

2>4B 

SB 

Mean 

2B 

2KB 

3B 

B.  S  

0.653 
.657 
.659 

0.584 
.585 
.588 

0.537 
.542 
.543 

0.591 
.595 
.597 

—0. 003 
+  .001 
+  .003 

-0.002 
-  .001 
+  .002 

-0.  004 
+  .001 
+  .002 

0.003 
.001 
.002 

0.002 

E.T.L 

N.R.L 

.002 
.001 

Mean 

.656 

.586 

.541 

.594 

.002 

.002 

.002 

.002 

.002 

Flicker  Photometer 


U.G.I 


0.646 


0.579 


0.529 


0.585    -0.010   -0.007    -0.012 


0.005 
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V.  RESULTS  ON  THE  LAMPS 

The  results  on  the  lamps  were  expressed  differently  by  each 
laboratory.  One  (E.  T.  L.)  gave  all  the  values  in  candlepower; 
another  (U.  G.  I.)  reported  the  values  as  ratios  using  the  value 
at  the  lowest  voltage  as  unity;  and  the  third  (N.  R.  L.)  gave  the 
ratio  of  the  candlepower  at  each  voltage  to  the  candlepower  at 
the  ne^t  lower  voltage.  Only  one  laboratory  (N.  R.  L.)  reported 
the  values  of  the  individual  observers  as  was  done  by  all  in  their 
reports  on  the  screens.  For  this  reason  only  the  mean  values 
obtained  by  each  laboratory  are  given  in  the  table  of  results 
(Table  7). 

The  Bureau's  values  of  both  current  and  candlepower  were  read 
from  the  characteristic  curves  previously  determined  by  a  group 
of  observers  whose  mean  was  practically  the  same  as  the  mean  of 
the  group  that  made  the  measiurements  on  the  screens. 

In  the  Electrical  Testing  Laboratories  the  candlepower  meas- 
urements were  made  by  two  observers  (M.  H.  T.  and  C.  E.  H.) 
whose  mean  was  the  same  as  the  mean  of  all  the  observers  on 
the  screens  and  the  color  steps  were  made  with  Wratten  filters 
which  had  been  calibrated  by  a  large  number  of  observers.  In 
the  Nela  Research  Laboratory  the  measurements  on  the  lamps 
and  screens  were  made  b}^  the  same  group  of  observers  with  the 
exception  that  observer  M.  L.  made  no  measurements  on  the 
lamps.  The  cascade  method  was  used  in  determining  values  on 
the  lamps  at  the  various  voltages. 

In  the  U.  G.  I.  Laboratory  the  lamps  were  measured  with  a 
Lummer-Brodhun  photometer  having  in  the  eyepiece  a  Crova 
solution  calibrated  on  the  photometric  scale  there  used  in  which 
are  involved  the  flicker  photometer  under  certain  chosen  illumina- 
tion and  other  conditions  and  the  selection  of  observers  from  a 
large  group.  The  group  used  as  a  basis  for  the  Crova  solution 
work  consisted  of  61  observers;  the  glass  screen  calibrations  were 
on  the  basis  of  a  group  of  25 


298  Bulletin  of  the  Bureau  of  Standards 

TABLE  7 
Candlepower  and  Current  Values  Found  by  the  Different  Laboratories 


[Vol.  13 


Volta 

Relative  candlepower 

Amperes 

LampNos. 

Lummer- 

Brodhun  photometer 

Flicker 
photo- 
meter 

B.S. 

E.  T.  L. 

N.  R.  L. 

U.  G.  I. 

B.S. 

E.  T.  L. 

N.  R.  L. 

U.  G.  I. 

71 

1.000 

1.000 

1.000 

1.00 

0.  3646 

0.  3647 

0. 3646 

0.  3650 

81 

1.674 

1.677 

1.  684 

1.68 

.3944 

.3944 

.3944 

.3951 

2608 

91 

2.604 

2.616 

2.627 

2.60 

.4224 

4229 

.4226 

.4234 

101 

3.832 

3.848 

3.864 

3.83 

.4495 

.4498 

.4496 

.4500 

111 

5.392 

5.434 

5.460 

5.34 

.4753 

.4758 

.4756 

.4757 

70 

1.000 

1.000 

1.000 

1.00 

.3926 

.3925 

.3920 

.3929 

80 

1.687 

1.695 

1.696 

1.69 

.4245 

.4249 

.4244 

.4253 

2662 

90 

2.638 

2.647 

2.651 

2.60 

.4549 

.4555 

.4551 

.4555 

100 

3.896 

3.923 

3.931 

3.88 

.4843 

.4846 

.4840 

.4844 

110 

5.501 

5.554 

5.585 

5.45 

.5118 

.5125 

.5120 

.5121 

72 

1.000 

1.000 

1.000 

1.00 

.2625 

.2628 

.2626 

.2625 

82 

1.659 

1.659 

1.674 

1.65 

.2838 

.2841 

.2838 

.2840 

2865 

92 

2.567 

2.579 

2.615 

2.56 

.3037 

.3041 

.3036 

.3035 

112 

5.277 

5.354 

5.389 

5.28 

.3408 

.3411 

.3406 

.3408 

132 

9.40 

9.45 

9.58 

9.22 

.3744 

.3752 

.3748 

.3749 

72 

1.000 

1.000 

1.000 

1.00 

.2611 

.2615 

.2614 

.2616 

92 

2.576 

2.588 

2.621 

2.58 

.3020 

.3024 

.3024 

.3024 

2866 

112 

5.304 

5.355 

5.415 

5.30 

.3390 

.3395 

.3393 

.3394 

122 

7.191 

7.223 

7.321 

7.16 

.3562 

.3568 

.3566 

.3566 

132 

9.46 

9.52 

9.63 

9.38 

.3728 

.3735 

.3732 

.3731 

The  Nela  Research  lyaboratory  gave  the  highest  and  lowest 
ampere  values  at  each  voltage,  but  to  make  the  results  uniform 
with  the  definite  values  reported  by  the  other  laboratories  the 
mean  of  these  extremes  at  each  voltage  was  assumed  as  the  cor- 
rect ampere  value.  The  deviations  of  the  ampere  values  as  given 
for  the  various  laboratories  in  Table  7  from  the  mean  of  all  at 
each  voltage  have  been  computed  and  found  to  be,  on  the  average, 
about  0.05  per  cent  and  the  same  for  all  four  lamps. 

In  Table  8  are  given  the  values  of  the  ratios  of  the  candle- 
power  at  each  voltage  to  that  at  the  lowest  voltage,  which  corres- 
ponds to  4-wpc  carbon  color.  The  laboratories  are  arranged  in 
the  order  in  which  they  measured  the  lamps.  As  in  the  case  of 
the  results  on  the  glass  screens,  the  values  obtained  by  each  lab- 
oratory are  compared  with  the  mean  of  the  three  laboratories 
using  lyummer-Brodhun  photometers. 
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Voltage 
ratio 

Candlepower  ratio 

Lamp  Noa. 

Lummer-Brodhun  photometer 

Flicker 
photo- 
meter 

B.S. 

E.  T.  L. 

N.  R.  L. 

Mean 

U.  G.  I. 

2608        -                               

81:71 
80:70 
82:72 

1.674 
1.687 
1.659 

1.677 
1.695 
1.659 

1.684 
1.696 
1.674 

1.678 
1.693 
1.664 

1.68 

2662  

1.69 

2865                               

1.65 

1.673 
-  .3 

1.677 
-  .1 

1.685 

+  .4 

1.678 
.3 

1.673 

Devistion  from  mean  (per  cent) 

—    3 

2608 

91:71 
90:70 
92:72 
92:72 

2.604 
2.638 
2.567 
2.576 

2.616 
2.647 
2.579 
2.588 

2.627 
2.661 
2.615 
2.621 

2.616 
2.649 
2.587 
2.595 

2.60 

2662            .          

2.60 

2865 

2.56 

2866                                       

2  58 

Mean            

2.596 
-  .6 

2.608 
-  .2 

2.631 
+  .7 

2.612 
.5 

2.585 

Deviation  from  mean  (per  cent) 

—1  0 

2608 

101:71 
100:70 

3.832 
3.896 

3.848 
3.923 

3.864 
3.931 

3.848 
3.917 

3.85 

2662 

3.88 

Mean       

3.864 
-  .5 

3.880 
+  .1 

3.898 
+  .4 

3.883 
.3 

3  855 

—  .5 

2608 

111:71 
110:70 
112:72 
112:72 

5.392 
5.501 
5.277 
5.304 

5.434 
5.554 
5.354 
5.355 

5.460 
5.585 
5.389 
5.415 

5.429 
5.  547 
5.340 
5.358 

5.34 

2662                       .                  

5  45 

2865  

5.28 

2866 

5.30 

Mean 

5.368 
-  .9 

5.424 
+  .1 

5.452 
+  .8 

5.413 
.6 

5  342 

Deviation  from  mean  (per  cent) 

—  1.4 

2866 

122:72 

7.191 

7.223 
,    -.3 

7.321 
+1.0 

7.245 

7.16 

—1.2 

2865 

132:72 
132:72 

9.40 
9.45 

9.45 
9.52 

9.58 
9.63 

9.48 
9.54 

9.22 

2865 

9  38 

Mean 

9.43 

9.48 
-  .3 

9.61 

+  1.0 

9.51 

9.30 

—  2.2 

In  order  to  determine  later  the  agreement  of  the  measurements 
on  the  lamps  with  those  on  the  screens,  percentage  deviations 
from  the  mean  obtained  for  all  lamps  at  each  voltage  are  given  in 
Fig.  I ,  and  the  representative  curve  for  each  laboratory  is  drawn. 
The  points  at  which  the  screens  fall  (i.  e.,  the  approximate  voltage 
to  which  a  tungsten  test  lamp  would  have  to  be  set  to  obtain  a 
color  match  with  the  screen  removed)  are  indicated  by  the  vertical 
50239°— 16 9 
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dotted  lines  which  intersect  the  curves  of  this  figure.  Correction 
to  the  mean  value  of  the  transmission  of  each  screen  may  now  be 
assigned  from  a  consideration  of  the  percentage  difference  on  the 
lamps,  as  shown  in  the  figure  at  the  intersection  with  the  corre- 
sponding vertical  line.  There  is  thus  obtained  for  the  screens  a 
relation  among  the  laboratories  corresponding  to  that  given  by 
the  curves  for  the  lamps  over  the  range  covered  by  the  screens. 
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Fig.  I. — Values  on  the  lamps  expressed  as  differences  from  the  mean  obtained  by  the  three 
laboratories  using  Lummer-Brodhun  photometers.  The  dots  at  100,  no,  120,  and  ijo 
volts  represent  flicker  values  found  by  Crittenden  and  Richtmyer.     (See  Section  VI.) 


VI.  COMPARISON  OF  RESULTS  ON  LAMPS  AND    SCREENS 

The  values  obtained  for  the  glasses  by  direct  measurement  and 
those  by  computation  (see  Sec.  V)  from  the  results  on  the  lamps 
are  compared  in  Table  9.  In  the  last  four  columns  of  the  lower 
half  of  the  table  are  the  differences  between  these  two  sets  of 
values.  It  is  to  be  noted  that  for  the  three  laboratories  using 
the  Lummer-Brodhun  photometer  the  differences  average  about 
0.2  per  cent  on  the  mean  of  the  three  glasses.  That  is,  each  labora- 
tory was  remarkably  consistent  in  the  two  series  of  meastirements. 
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TABLE  9 
Comparison  of  Observed  and  Computed  Values  on  the  Screens 
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Screens 

Values  of  screens  as 

observed 

B.  S. 

E.  T.  L. 

N.  R.  L. 

Mean 

U.  G.  I. 

2B 

0.653 
.584 
.537 

0.657 
.585 
.542 

0.659 
.588 
.543 

0.656 
.586 
.541 

0.646 

254B 

.579 

3B                                             :-.- 

.529 

Mean 

.591 

.595 

.597 

.594 

585 

Screens 

Relative  values  as  computed  from 
measurements  on  lamps 

Differences,  computed  values  from 
observed  values 

B.S. 

E.  T.  L. 

N.  R.  L. 

U.  G.  I. 

B.S. 

E.  T.  L. 

N.  R.  L. 

U.  G.  I. 

2B 

0.653 
.5825 
.537 

0. 6555 
.5855 
.5405 

0. 6595 
.5905 
.5455 

0. 6525 

.5815 
.5355 

0.000 

+  .0015 
.000 

+0. 0015 

-  .0005 
+  .0015 

-0.  0005 

-  .0025 

-  .0025 

-0. 0065 

2^B       

—     0025 

3B 

—  .0065 

Mean 

.591 

.594 

.5985 

.590 

.0005 

.0012 

.0018 

.0052 

In  regard  to  the  flicker  values,  it  appears  that  the  somewhat 
greater  differences  between  the  results  on  the  glasses  and  the 
lamps  is  due  to  the  values  assigned  to  the  former.  As  further 
evidence  of  this  fact,  the  results  by  Crittenden  and  Richtmyer  ^ 
on  two  of  the  lamps  (Nos.  2865  and  2866),  using  color  screens 
calibrated  by  means  of  a  flicker  photometer,  agree  very  closely, 
except  at  120  volts,^  with  those  reported  by  the  U.  G.  I.,  their 
values  being  indicated  by  dots  in  Fig.  i.  On  the  other  hand,  the 
results  given  by  the  same  authors  for  the  screens  by  the  flicker 
method  do  not  agree  so  well  with  the  U.  G.  I.  values  here  reported. 

The  differences  given  in  this  table  show  that  the  first  three 
laboratories  mentioned  are  consistent  in  their  meastu'ements  on 
the  lamps  and  screens  to  within  less  than  0.2  per  cent  on  the 
average,  and  that  the  U.  G.  I.  computed  value  is  practically  the 
same  as  that  of  the  Bureau  of  Standards. 


VII.  ADDITIONAL  CHECK  MEASUREMENTS 

In  order  to  secure  a  further  check  of  the  ratio  of  the  values 
obtained  by  the  Nela  Research  Laboratory  and  the  Bureau  of 
Standards,  arrangements  were  made  whereby  F.  E.  Cady,  through 

6  Trans.  I.  E.  S.,  11,  p.  331.  1916. 

^  These  authors  state  that  this  value  should  not  be  given  equal  weight  with  the  others  because  only  one 
lamp  was  measured  at  this  voltage. 
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the  courtesy  of  Dr.  Hyde,  came  to  the  Bureau  and  made  a  number 
of  comparative  measurements  with  the  Bureau's  observers  who 
took  part  in  this  intercomparison. 

Comparative  measurements  were  first  made  of  the  ratio  Y/B 
and  of  the  transmission  of  a  glass  screen  (3G)  using  the  flicker 
photometer.  (See  next  section.)  In  these  measurements  the 
B.  S.  observers  checked  their  former  values  to  within  the  errors 
of  observation,  and  hence  their  values  in  this  test  are  not  here 
given.  Following  this  test,  one  of  the  lamps  (No.  2661)  used  in 
establishing  the  voltage-candlepower  curve  for  tungsten  lamps 
was  measured  at  106  volts  in  terms  of  its  value  at  70  volts  using 
a  lyummer-Brodhun  photometer.  At  the  latter  voltage  the  color 
of  this  lamp  was  the  same  as  that  of  a  4-wpc  carbon  and  at  the 
upper  voltage  the  color  corresponded  to  that  produced  by  glass 
3B  when  used  with  a  4-wpc  carbon  lamp.  The  comparison  lamp 
was  adjusted  for  color  match  with  No.  2661  at  70  volts,  and  the 
illumination  on  the  photometer  screen  was  adjusted  to  10  meter- 
candles  as  in  all  the  previous  measurements  made  at  the  Bureau 
in  this  intercomparison.  Three  series  of  determinations  of  the  ratio 
of  candlepower  at  the  two  voltages  were  made  by  five  observers, 
including  Mr.  Cady,  and  all  settings  were  made  by  the  contrast 
principle  as  was  done  in  all  the  previous  measurements  at  the 
Bureau.  These  results,  together  with  the  values  previously 
obtained  for  3B  by  these  five  observers  (see  Table  5),  each  in  his 
own  laboratory,  are  given  in  Table  10. 

TABLE  10 
Comparison  of  Check  Measurements 


Observers 


Series  1 


Series  2 


Series  3 


Mean 


Trans- 
mission 
of  3B, 
from 
Table  5 


F.E.  C... 
G.W.M. 
J.F.S.... 
W.J.X.. 
G.J.S... 


Mean  of  the  four  B.  S.  observers. 

Value  from  B.  S.  voltage-candlepower  curve. 


4.90 
4.85 
4.79 
4.80 
4.30 


4.92 
4.87 

4.84 
4.81 
4.76 


4.91 
4.81 
4.81 
4.73 

4.73 


4.81 


4.82 


77 


4.91 
4.85 
4.81 
4.78 

4.77 


4.80 
4.81 


0.547 
.542 
.538 
.534 
.536 


.5375 
.538 
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A  comparison  of  the  last  two  columns  shows  that,  for  the 
lamp,  the  percentage  difference  between  the  value  of  Mr.  Cady 
and  the  mean  of  the  B.  S.  observers  is  practically  the  same  as  for 
the  screen,  although  the  latter  was  measured  under  considerably 
different  conditions  of  illumination  in  the  two  laboratories.  As 
the  color  step  was  the  same  in  each  case,  it  can  be  reasonably 
concluded  from  this  check  that  the  indicated  small  difference 
between  the  two  laboratories  is  real  and  is  due,  at  least  in  a  great 
measure,  if  not  entirely,  to  a  difference  in  the  characteristics  of 
the  two  groups  of  obser\^ers.  In  this  connection  it  is  of  interest 
to  note  that  if,  in  either  laborator}^  the  first  half  of  the  obsen^ers, 
in  the  order  given  in  Table  5,  be  arbitrarily  taken  as  one  group 
and  the  other  half  as  a  second  group,  the  difference  between  the 
value  by  the  two  groups  in  either  laboratory  is  comparable  with 
the  difference  between  the  laboratories  themselves. 

It  is  obvious,  therefore,  that  all  measurements  involving  a 
color  difference  should  be  left  as  much  as  possible  to  the  standard- 
izing laboratory  where  the  obser\'ers  should  be  carefully  selected, 
their  relation  to  normal  determined,  and,  if  necessary,  corrections 
made  to  their  observations. 

VIII.  CHARACTERISTICS  OF  THE  BUREAU  OF  STANDARDS' 

OBSERVERS 

In  the  investigation  by  Crittenden  and  Richtmyer,  referred  to 
in  Section  VI,  the  observers  who  took  part  in  this  intercompari- 
son  determined,  with  the  flicker  photometer,  a  value  for  the  ratio 
of  the  Ives- Kingsbury  yellow  and  blue  solutions,^  and  also  a  value 
for  the  transmission  of  glass  screen  3G.  These  values,  together 
with  the  values  obtained  with  the  Summer- Brodhun  photometer 
for  glass  screen  3B  (Table  5,  direct  method),  which  had  about  the 
same  color  density  as  3G,  are  given  in  Table  11.  In  this  table  are 
included  also  the  mean  values  by  the  114  observers  used  by 
Crittenden  and  Richtmyer,  the  values  by  Mr.  Cady,  and  those  by 
Dr.  C.  H.  Sharp  and  Dr.  H.  E-  Ives,  who  were  observers  in  their 
respective  laboratories  and  who  visited  the  Bureau  and  made 
their  measurements  during  the  progress  of  the  above  investiga- 
tion by  Crittenden  and  Richtmyer. 

8  Trans.  I.  E.  S.,  10,  p.  203;  1915. 
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TABLE  11 
Data  on  Observers 


Ratio 
Y-^B 

Transmission 

Deviations  from  average 
of  114  observers 

Difierence 
between 
deviations 

Observers 

3G. 

Flicker 
photometer 

3B. 
Lummer- 
Brodhun 
photometer 

Flicker 
photometer 

Lummer- 

Brodhun 

photometer 

G.  W.  M.  (B.  S.) 

J.F.S.(B.S.) 

B.M.(BoS.) 

H.  B.S.  (B.S.) 

W.J.K.  (B.S.) 

W.H.V.(B.  S.) 

A.H.T.(B.S.) 

G.J.S.  (B.S.) 

1.025 
1.103 
1.120 
.822 
.968 
.948 
1.014 
.998 

0.540 
.534 
.532 
.559 
.540 
.548 
.542 
.540 

0.542 
.538 
.526 
.552 
.534 
.535 
.535 
.536 

-0.  003 

-  .009 

-  .011 
+  .016 

-  .003 
+  .005 

-  .001 

-  .003 

+0.008 
+  .004 
—  .008 
+  .018 
.000 
+  .001 
+  .001 
+  .002 

+0.  Oil 
+  .013 
+  .003 
+  .002 
+  .003 
-  .004 
+  .002 
+  .005 

Means 

1.000 

.542 

.537 

-  .001 

+  .003 

+  .004 

F.  E.  C.  (N.  R.  L.) 

C.  H.  S.  (E.  T.  L.) 

H.  E.  I.  (U.  G.  I.) 

1.044 
1.058 
.951 
.99 

.536 
.534 
.542 
.543 

.547 
.537 
.540 
.534 

-  .007 

-  .009 

-  .001 

+  .013 
+  .003 
+  .006 

+  .020 
+  .012 
+  .007 

It  is  to  be  noted  that,  although  there  is  considerable  variation 
in  the  ratio  Y/B  among  the  different  individuals  of  the  Bureau's 
group  of  eight  observers,  the  mean  of  all  is  remarkably  close  to  the 
characteristic  ratio  (0.99)  found  by  Crittenden  and  Richtmyer  for 
the  average  of  1 14  observers.  Hence,  as  is  evident  from  the  results 
on  3G,  a  mean  value  obtained  by  this  group  with  a  flicker  pho- 
tometer would  require  practically  no  correction  to  obtain  a  value 
corresponding  to  that  by  the  average  eye. 

A  comparison  of  the  values  on  3B  shows  that  this  group  is  very- 
close  to  the  average  of  the  114  observers  also  in  its  results  with  the 
lyUmmer-Brodhun  photometer,  although  not  quite  so  close  as  with 
the  flicker.  Whether  this  slightly  greater  variation  arises  from  the 
fact  that  in  the  average  eye  work  of  Crittenden  and  Richtmyer  the 
illumination  was  higher  than  in  this  investigation,  or  that  in  the 
former  the  photometer  was  used  as  an  equality  rather  than  as  a 
contrast  field,  or  (as  is  more  likely)  from  the  greater  uncertainty 
of  the  Lummer-Brodhun  photometer,  is  difficult  to  say.  However, 
as  is  shown  by  the  differences  between  deviations  and  better  by 
means  of  a  plot  between  values  of  Y/B  and  transmission  (Fig.  2) , 
all  the  individuals  of  this  group  do  not  have,  with  respect  to  the 
average  of  the  114,  the  same  relation  with  the  Ivummer-Brodhun 
photometer  as  they  do  with  the  flicker,  the  first  two  being  decidedly 
different  by  the  two  methods. 
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Now  it  is  found  that  if  these  two  observers  be  omitted  the  mean 
of  the  other  six  with  a  flicker  photometer  is  just  as  close  to  normal 
as  the  whole  group,  their  mean  flicker  values  for  3G  and  Y/B  being 
0.5435  ^nd  0.98,  respectively;  and,  further,  their  mean  Lummer- 
Brodhim  value  for  3B  is  more  nearly  equal  to  the  average  eye 
value  (0.534),  being  0.536  instead  of  0.537,  as  found  by  the  whole 
group.  It  would  appear,  therefore,  that  in  order  to  make  a  com- 
parison of  former  B.  S.  values  with  present  (average  eye)  values, 
as  is  done  below,  there  is  perhaps  some  advantage  in  using  the 
mean  of  this  "selected"  group  of  six. 
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Fig.  2. — This  is  a  plot  of  the  values  given  in  Table  ii.  The  ordinates  are  values  of 
transmission  expressed  as  differences  in  per  cent  from  the  corresponding  average  value 
obtained  by  114  observers.  Lummer-Brodhun  values  by  the  eight  B.  S.  observers  are 
represented  by  "X's  and  their  flicker  values  by  o's.  The  corresponding  values  by  the 
three  observers  from  the  outside  laboratories  are  represented  by  -\-^s  and  <t)'s,  respectively. 
The  curve  represents  the  flicker  data  obtained  by  the  114  observers. 

Further  checks  on  the  value  of  3B  from  the  present  investigation 
as  well  as  from  the  investigation  of  Crittenden  and  Richtmyer,  who 
determined  values  for  3G,  which  was  found  to  be  1.6  per  cent 
higher  than  3B,  are  given  in  the  following  table.  Nearly  all  of  the 
20  observers  selected  by  Crittenden  and  Richtmyer  from  the  114 
had  considerable  photometric  experience,  and  they  were  well  dis- 
tributed with  respect  to  the  average  eye  characteristic  as  deter- 
mined with  a  flicker  photometer. 
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TABLE  12 

Comparison  of  Values  by  Different  Methods  and  also  by  Different  Groups  of 

Observers 
I.  With  the  Lummer-Brodhun  photometer: 

A.  As  found  in  Crittenden  and  Richtmyer's  investigation — 

1.  By  114  observers  selected  at  random  from  the  Bureau  of  Standards  scientific 

staff  (one  set  each) 3B  =  0. 534 

2.  By  20  observers  selected  from  the  114  (two  sets  each) SB  =0.536 

3.  By  14  most  consistent  observers  selected  from  the  20  (tviro  sets  each) 3B  =  0. 538 

B.  As  found  in  this  intercomparison— 

1.  BySobservers 3B=0.537 

2.  By  6  observers  selected  from  the  8 3B  =0.536 

n.  With  the  flicker  photometer: 

A.  As  found  in  Crittenden  and  Richtmyer's  investigation— 

1.  By  114  observers  (same  as  above) 3B  =0. 534 

2.  By  20  observers  (same  as  above) 3B  =0. 534 

3.  By  14  observers  (same  as  above) 3B  =  0. 534 

4.  By  8  observers  (same  as  above) 3B  =0.533 

5.  By  6  observers  (same  as  above) 33=0.534 

B«  As.  found  in  this  intercomparison— 

1.  By  U.  G.  I.,  direct  measurement 3B  =  0. 529 

2.  By  computation  from  U.  G.  I.  measurements  on  lamps  with  the  Lummer- 

Brodhun  photometer  and  a  Crova  solution  calibrated  by  a  method  involving 

the  flicker  photometer 3B  =  0. 535 

From  the  above  comparison  it  is  apparent  that  for  the  color 
difference  here  represented  the  group  of  eight,  as  weh  as  the  group 
of  six,  is  as  nearly  normal  as  it  is  possible  for  a  small  group  to 
reproduce  average  eye  values  with  the  respective  photometers 
mentioned. 

IX.  CHECK  OF  FORMER  VALUES 

Screen  2XB  was  chosen  for  this  intercomparison  because  it 
had  approximately  the  same  color  value  as  the  glasses  used  in  the 
intercomparison  with  the  National  Physical  Laboratory.  The 
mean  values  found  for  this  screen  by  the  group  of  eight  and  by 
the  group  of  six  were  0.5836  and  0.5828,  respectively.  The  rela- 
tive value  of  2%'B  to  3KC,  which  is  one  of  the  glasses  used  in  the 
B.  S.-N.  P.  L.  intercomparison,  has  been  recently  determined  and 
found  to  be  as  follows : 

3KC=2KB    +O.CIO 

Therefore,  by  the  group  of  8  observers 3>^C=o.  5836+0.  010=0.  5936 

And  by  the  group  of  6  observers 3^0=0.  5828+0.  010=0.  5928 

Value  used  in  the  B.  S.-N.  P.  L.  intercomparison  in  191 1 o.  5924 

Although  in  the  earlier  measurements  made  by  the  Bureau  of 
Standards  no  method  of  selection  of  observers  was  employed  and 
the  illumination  used  was  that  employed  in  other  work  done  at 
the  Bureau  and  was  much  lower  than  that  used  in  the  recent 
investigation  of  Crittenden  and  Richtmyer,  nevertheless  it  appears 
from  the  agreement  in  the  above  values  that  the  considerable 
deviations  from  the  mean  of  some  of  the  observers  at  that  time 
were  such  that  the  plus  and  minus  deviations  substantially  coun- 
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terbalanced  each  other,  and  the  figures  then  obtained  by  the 
Bureau  with  the  Lummer-Brodhun  photometer  correspond  closely 
to  those  now  obtained  by  an  average  eye  w^orking  under  the  higher 
illumination  used  by  the  investigators  mentioned.  Of  course,  it 
would  not  be  expected  that  such  deviations  would  all  be  in  one 
direction,  but  that  they  were  averaged  out  so  completely  was  a 
matter  of  good  fortune. 

X.  CONCLUSION 

The  results  of  this  intercomparison  show  quite  conclusively 
that  in  each  laboratory,  regardless  of  the  kind  of  photometer 
used,  even  though  a  considerable  color  difference  v/as  involved, 
each  observer  maintained  a  fairly  constant  criterion  with  respect 
to  the  mean.  The  same  is  true  of  each  laboratory  in  respect  to 
its  relation  to  the  mean  of  all,  as  judged  by  the  measurements  on 
the  glass  screens  and  those  made  on  the  lamps  some  months 
afterward. 

Considering  the  difficulties  involved  in  the  measurements,  the 
different  characteristics  of  observers  and  the  wide  difference  in 
illumination  employed,  covering  probably  a  range  of  ten  times, 
the  agreement  among  the  laboratories  must  be  considered  remark- 
ably good.  It  is  true,  however,  that  although  the  differences  are 
small  they  are  not  negligible  in  precision  photometry. 

It  is  evident,  therefore,  that  measurements  to  establish  standards 
involving  a  color  difference  should  be  left  as  much  as  possible  to 
the  standardizing  laboratory  where  the  observers  must  be  care- 
fully selected  and  a  considerable  number  employed  and  the  kinds 
of  instruments  and  the  conditions  of  illumination,  etc.,  definitely 
fixed. 

An  examination  of  the  Bureau's  observers  who  took  part  in 
this  work  shows  that  their  mean  characteristic  is  very  approxi- 
mately the  same  as  that  of  the  "  average  eye,"  as  determined  from 
a  test  of  114  observers  taken  at  random  from  the  Bureau's  scien- 
tific staff. 

Further  evidence  is  obtained  as  to  the  accuracy  of  the  values 
assigned  to  a  group  of  1.5-wpc  tungsten  standards  used  in  a 
previous  intercomparison  with  the  National  Physical  Laboratory 
of  England. 

The  authors  express  the  Bureau's  appreciation  of  the  coopera- 
tion of  the  laboratories,  and  of  those  who  represented  them,  in 
carrying  out  this  investigation. 

Washington,  January  22,  1916. 


